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MidTerm  Overall 
Evaluation  Report 


PROPOSAL:  2000000154 

TITLE;  Implementation  and  Evaluation  of  a  Web-based  Automated  Mental  Health  Intake  System 


ACCOMPLISHMENTS 

Protocol:  A  complete  protocol  was  submitted  to  the  Walter  Reed  Army  Medical  Center  Department 
of  Clinical  Investigations  (WRAMC-DCI)  on  6  November  2001.  The  WRAMC-DCI  reviewers  tabled 
the  protocol  and  suggested  that  we  resubmit  after  making  a  number  of  recommended  changes. 

These  changes  are  being  made  and  we  will  be  ready  to  resubmit  in  early  January.  Functional 
Requirements:  We  completed  functional  requirements  for  system  design  and,  pending  completion  of 
a  contract,  the  system  description,  functional  requirements  and  contract  will  be  sent  out  for  bids. 
Other  accomplishments  include:  ?  Hired  a  full-time  research  assistant  (part  time  for  this  project)  ? 
Contracted  a  legal  consultant  to  research  legal  issues  and  develop  legal  policy  in  the  area  of 
telemedicine/telepsychiatry/web-based  information.  The  consultant  completed  the  task.  ?  Designated 
space  and  purchasing  equipment:  designing  and  locating  the  research  office  and  patient  computer 
area,  ordering  some  equipment  (one  computer  and  furniture),  completing  the  work-order  for  cable 
and  T1  lines.  ?  Secured  contracts  for  electronic  version  of  questionnaires,  ?  Revised  and  streamlined 
all  intake  related  clinic  forms  ?  Developed  research  questionnaires  based  on  reviewed  literature  and 
existing  validated  instruments,  ?  Delivered  several  presentations  on  legal  and  technological  aspects  of 
the  project  at  the  Army  Behavioral  Health  Short  Course,  August  2001. 


PFs  Accomplishment  Evaluation:  :  a\: i  '  o;;;-; 


PROBLEMS 

Legal  complexities  involved  in  attempts  to  acquire  rights  to  use  one  of  our  existing  clinic  outcome 
measures  (YOQ)  slowed  instrument  development  in  March/April  and  were  finally  resolved  by 
adopting  a  different  instrument  (Ohio  Scales).  Progress  on  all  aspects  of  the  project  was 
considerably  slowed  beginning  with  the  departure  of  our  first  research  assistant  in  early  June 
quickly  followed  by  PCS  of  a  major  contributor  who  then  became  a  collaborator.  A  week-long  loss 
of  power  at  WRAMC  in  August  halted  progress  entirely  (power  was  not  fully  restored  to  many 
peripheral  buildings,  including  our  building,  until  early  September).  The  11  September  terrorist 
attacks  followed  almost  immediately  on  the  heals  of  the  power  outage.  Little  work  was  done  on  the 
project  during  September  and  October  2001  due  to  diversion  of  staff  in  support  of  Operations  Noble 
Eagle,  Enduring  Freedom  and  Operation  Solace.  Coordinating  technical  information  for  the 
functional  requirements  and  securing  the  bid  has  taken  longer  than  initially  anticipated.  Initial 
review  of  the  protocol  on  6  November  by  DCI  has  required  a  complete  rewrite,  changing  the 
protocol  from  a  rigorous  scientific  design  to  a  feasibility  study.  This  is  currently  in-progress. 


PPs  Problem  Area  Evaluation:  : 
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LIFE-CYCLE 


Although  behind  schedule,  the  project  will  continue  as  planned.  Once  the  automation  system  has 
been  built,  and  the  protocol  has  been  officially  approved,  we  will  begin  to  collect  the  data.  Once  data 
collection  is  complete,  we  will  analyze  and  report. 


Pi's  Life- Cycle  Evaluation:  :  / v:-- rs 


DELIVERABLES 

The  final  result  will  produce  data  on  the  feasibility  of  an  operative  web-based  patient  intake  system. 
Analysis  of  the  data  will  provide  a  test  of  concept  and  “lessons  learned’’  for  development  of  other 
web-based  components  of  the  evolving  Behavioral  Health  Computer  System. 


Pi's  Deliverables  Evaluation:  : 

Deliverable  is  on  schedule  per  Proposal 

Expenditui'es 

1ST  Quarter 

2nd  Quarter 

Element  of  Resource  (EOR) 

Oct  1  -  Dec  31 

Jan  1  -  Mar  31 

Travel  2100 

$1,692.24 

$0.00 

Shipping  2200 

$0.00 

$0.00 

Rent  &  Communications  2200 

$0.00 

$135.00 

Contract  for  Services 

2500 

$11,455.23 

$42,352.12 

Supplies 

2600 

$0.00 

$0.00 

Equipment 

3100 

$3,152.50 

$6,490.96 

Financial  Narrative: 

Travel  expenditures  were  made  for  two  individuals  to  attend  a  telemedicine  conference  in  Florida.  A 
communication  expenditure  was  made  to  fund  a  presentation  at  a  behavioral  short  course, 
discussing  the  project.  Contract  for  Services  funding  has  gone  towards  the  research  assistant  and  has 
secured  the  expertise  of  a  legal  specialist  in  the  area  of  health  infomatics.  This  individual  is  ensuring 
that  our  effort  is  LAW  federal  law  and  Army  regulation  and  is  also  assisting  us  through  the 
institutional  review  board,  human  use,  and  contracting  obstacles.  Purchased  equipment  are  the 
following:  Dell  Precision  330,  Vanderbilt  form,  Ohio  Scales  license,  electronic  rights  to  Checkmate 
Plus,  and  furniture. 


PFs  Financial  Evaluation:  :  Deliverable  is  on  schedule  per  Proposal 
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